MADPH-05-1425,CUMQ/HEP-134,WM-05-108 



Width Effects on Near Threshold Decays of the Top Quark 
t — ^ cVFW, cZZ and of Neutral Higgs Bosons 

Shaouly Bar-Shalom/ 'Q Gad Eilam/'^'Q Mariana Frank, ^'P and Ismail Turan^'^'P 

^Department of Physics, Technion- Israel Institute of Technology, 32000 Haifa, Israel 
^Department of Physics, University of Wisconsin, Madison, WI 53706, USA 
^Department of Physics, Concordia University, 
7141 Sherbrooke St. West, Montreal, Quebec, CANADA H4B 1R6 

^Particle Theory Croup, Department of Physics, 
College of WilUam and Mary, Williamsburg, VA 23187-8795, USA 

(Dated: February 2, 2008) 

Abstract 

The nonzero widths of heavy particles become significant when they appear in the final state 
of any decay occurring just around its kinematical threshold. To take into account such effects, a 
procedure, called the convolution method, was proposed by Altarelli, Conti and Lubicz. We expand 
their study which included only threshold effects for t — > bWZ in the standard model. We discuss 
finite width effects in the three body decays t — > cWW,cZZ and A^{h^) tbW in the type III 
version of a two Higgs doublet model. In particular, we find a substantial enhancement in the decay 
t cZZ, which brings its branching ratio to BR(t — > cZZ) ~ 10~'^, and in the decay A^ tbW, 
which, unlike the h^ case, becomes competitive with the A^ two-body decay modes. 
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I. INTRODUCTION 



The finite width of a particle is directly related to its instability. When its width is small 
with respect to its physical mass, finite width effects (FWE) are usually neglected except for 
decays in which a resonance can emerge when the particle appears as an intermediate state, 
or in decays that are kinematically allowed only very close to threshold and the particle 
is involved in either the initial or the final state. The former case is usually handled with 
the Breit-Wigner prescription, while the latter case, i.e., taking into account the FWE in 
processes occurring just around their kinematical threshold, needs special attention. 



In this respect, there are two different methods proposed in the literature 



They 



were referred to by Altarelli, Conti and Lubicz as the decay-chain method (DCM) and 
the convolution method (CM).^ In the first approach (i.e., the DCM), the dominant decay 
modes of the unstable final state particles are taken into account as subsequent decays to 
obtain the "total" decay rate and then the branching ratio for the "signal" (i.e., with the 



unstable particle in the finite state) is calculated by taking the ratio of t 



le "total" decay 
This method 



rate to the multiplication of rates of the subsequent decay modes 
requires kinematical cuts in order to maintain the direct connection between the "signal" 
and the total number of events. That is, since the observed final state (with its subsequent 
decay products) could be produced through other channels, kinematical cuts are required 
to minimize this undesired background. Therefore, this method leads to physical quantities 
which depend on kinematical cuts and so it inherits some degree of experimental difficulties. 

Alternatively, in the CM the instability of a final state particle is described instead 
by a Breit-Wigner-like density function whose central value and half-width are governed 
by the width and the physical invariant mass of the particle. In this way, the unstable 
particle produced can be seen effectively as a real physical particle, having an invariant 
mass which is controlled by its density function. Although this method does not require any 
kinematical cut, it doubles the number of phase space integrals, making it computationally 
more challenging. 

In this paper we employ the CM to study FWE in the three-body flavor changing rare 
top decays t — > cWW and t cZZ, by including the widths of W and Z bosons. These 



^ An alternative approach has been recently discussed by Kuksa pj, based on the uncertainty relation for 
the mass of the unstable particle. This method has a close analogy to the convolution method. 
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decay modes and other two and three-body rare flavor changing top decays '6], can provide 
a unique testing ground for the standard model (SM) Glashow-Iliopoulos-Maiani (GIM) 
mechanism and may give hints about - beyond the SM - flavor changing physics such as 
may occur in some variations of Two-Higgs Doublet Models (2HDM's). FWE in these 
decay modes will be studied within the SM (in the case of t ^ cWW) and in the context 
of the type III Two Higgs Doublet Model (in both t cWW and t cZZ), which 
admits flavor changing neutral currents (FCNC) at the tree-level. The three-body top 
decays t cWW, bWZ, cZZ have been considered before, without including FWE, in the 
SM & B a, . 2HDM. a H y Q Q, in a ,enenc fo^aUs. .c.ud,ng scalar, vector 
or fermion exchanges 3| and in top color-assisted Technicolor model In addition, the 
top decays t —>■ bWh^ and t — > bWA^ have been analyzed in the context of a general 2HDM 
Iq . Among the above decay modes, a simple threshold analysis shows that t cZZ 
and t bWZ are potentially the most sensitive to FWE. In particular, according to the 
recent CDF analysis based on the Tevatron RUN II data, the top mass is (Icr) jljl: mt = 
173. 5^2 6 (stat) ± 4.0 {systY In fact, these later top mass measurements imply that for the 
stable Z-bosons case (i.e., without including FWE) the decay t — * cZZ cannot occur if the 
top mass lies within its recent CDF and DO la limits. We, therefore, expect FWE to be 
substantial in this decay. Indeed, we find that FWE (due to the rather large 0{GeV) Z- 
width) can give BR(t cZZ) ~ 10~^ — 10~^ (as opposed to null in the stable case), within 
some range of the allowed parameter space of the type III 2IIDM. Moreover, even for the 
decay t cWW, for which the central value of the top-quark mass (i.e., nit = 173.5) is 
about 10 GeV away from the kinematical threshold, we find that FWE from the unstable 
W-bosons can cause a several orders of magnitudes enhancement in the type III 2IIDM 
with a light neutral Higgs of mass 171^0 ^ 2mw, thus elevating the branching ratio from 
BR(t ^ cWW) ~ 10-9 - 10-^ to BR(t ^ cWW) ~ 10"^ - 10-^ in this case. Clearly, 
such large branching ratios would be accessible to the LHC and may even be detected at 
the Tevatron. A similar large enhancement due to FWE was found for the decay mode 
t bWZ in both the CM MT and the DCM In particular, have found that, 

in the SM, the FWE increase this decay width by orders of magnitude (with respect to the 

2 Note that later DO results from Tevatron RUN II, rut = 170.6±4.2 {stat)±6.0 (syst) (see [l^i), are based 
on less accumulated data and has larger statistical and systematic uncertainties. 
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stable final state gauge bosons), giving BR(t — > bWZ) ^ 2 x 10~^ for rrit ~ 176 GeV. 

To demonstrate the potential importance of FWE in neutral Higgs decays, we also ex- 
amine the three-body neutral Higgs decays tbW and tbW, within the type 
111 2HDM, assuming that either (the lighter CP-even neutral Higgs) or (the CP-odd 
neutral Higgs) have masses around rrit + + rriw (i.e., close to the threshold). It is well 
known that, for a SM-like Higgs, the two-body decay modes to the heaviest fermions and 
to the gauge bosons are dominant, since its couplings to these particles are proportional to 
their masses. Three-body sub-threshold decays (e.g., to W*W or Z*Z pairs) can also have 
sizable BR's despite the suppression factors involved In the context of the minimal 
super symmetric extension of the SM (MSSM) sub-threshold three-body decays of especially 
heavy Higgs bosons might also have a large branching ratio 3|- In this paper we show that, 
including the top quark and the W boson width in the framework of the CM, the three-body 
Higgs decays thW and A^ thW can be enhanced by about 3 orders of magnitudes 
in the type 111 2HDM if they occur just around their kinematical threshold. For the case of 
A^ —>■ tbW, such an enhancement can push its BR to the level of tens of percents and may, 
therefore, become critical for experimental searches of A^. 

The paper is organized as follows: In Section 11 we describe the convolution method. In 
Section 111 we give a brief overview of the type HI 2HDM. In section IV we examine the FWE 
in the top decays t — > cWW, cZZ and in section V we study the FWE in the three-body 
Higgs decays -—>■ tbW and A^ — > tbW. In Section VI we summarize our results. 



II. THE CONVOLUTION METHOD 



Particles with large width imply a large uncertainty in its mass from the mass uncertainty 
relation [20]. The CM can be used to include such large width effects in decays involving 
unstable particles in the final state. Consider for example the main top decay t bW. 
Since the W is unstable, we can define: r{t ^ bW) = T = "^T^ [t ^ bfj^), where the 

sum runs over all the W decay modes. Furthermore, F can be decomposed into two parts 
corresponding to the transverse (Fj^) and longitudinal (Tl) components of the intermediate 
ly-boson (see e.g., j^): 

r = FT + Fi, (2.1) 
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where 



T 



E / 7^ ,2 , ^ 72 ^ (2-2) 



and oc fXirii, mj), with / — > as m,, ^ 0. Also, mw is the mass of the W boson and 
lmIlT{p^) and ImULlp"^) (appearing in Tl) are the absorptive parts of the transverse and 



longitudinal vacuum polarization tensor (see e.g., J, |2l|). 

Using the Cutkotsky rule in the limit of massless fermion mi,m_,- —>■ (/», fj, are the 
fermions exchanged in the W self energy diagram), one obtains 
Imni(p^) and: 

/mn^(/) = V r° {W{p') ^ fJ,) = , (2.3) 

Tn\Y 

where is the usual on-shell decay width of W and a/p^ > "^i + ^j- Thus, in this limit 
r reduces to: 

r = rT= / dpV(/,^H^,Or°(t^6w^(p')) , (2.4) 

where p {p'^,mw,^w) "invariant mass distribution function", given by: 



p(p^mH.,0 = . (2.5) 

Eqs. ()2.4|) and ()2.5|) describe the factorization of the production and the decay modes of the 
W boson (in the limit of massless fermions). The case of a stable W boson (i.e., — > 0) 
makes p 6{p'^ — m'^) which sets F = F°(t — > bW), where F° is the width for an on-shell 
W without FWE. 

The above prescription can be generalized to the case of a generic three-body decay of 
the form a &V1V2, where Vi and V2 are vector bosons: 



T{a^bViV2)= dpi dpi pi {pl,mv^,T\) p2 {pl,mv^,T\) 

Jo Jo 

xT^a ^ bViipi)V2ipl)) . (2.6) 
Furthermore, for consistency of the CM one needs also the following modifications: 



5 



1. The sum over polarization vectors of a gauge-boson with an invariant mass should 
be taken as: 



p2 



(2.7) 



2. In calculating the "zeroth" width of the top-quark(Higgs) into the off-shell vector 
boson(s) [i.e., {a bVi{pl)V2{pl)) in Eq. ^ or 1° {H ^ ab{pi)V{pl)) for H = h° 
in Eq. ()5.H) ]. the tree- level propagator of the massive vector bosons should be modified 
as (in the unitary gauge): 



p"^ — my + imyF? 
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p^p" 



(2.8) 



ruy — imvTy 

This substitution is required since in the CM the invariant mass p^ is allowed to vanish, 
as can be seen from the integration limits in Eqs. ()2.4j) and ()2.(i|l . 

3. In order to restore gauge invariance in the -R^-gauge, the Feynman rules in which 
masses of such resonant intermediate particles appear should be modified to be func- 
tions of the corresponding invariant masses. Such a modification is, however, not 



necessary in the unitary gauge that we have used in all our calculations 



221. 



III. THE TWO HIGGS DOUBLET MODEL OF TYPE III 



One of the simplest extensions of the SM is obtained by enlarging the scalar sector 
with an additional SU{2)l doublet. In the most general case such a 2HDM gives rise to 



tree-level FCNC which are mediated by the physical Higgs bosons j23|. To avoid such 
potentially dangerous FCNC, one usually imposes an ad-hoc discrete symmetry [24 1 that 
leads to the type I or type II 2HDM (see for example 2^ and 3|). An alternative way 



for suppressing FCNC in a genera 
suggested by Cheng and Sher in 



3DM (i.e., without imposing discrete symmetries) was 
|. In the Cheng and Sher Ansatz the arbitrary flavor 
changing couplings of the scalars to fermions are assumed to be proportional to the square 
root of masses of the fermions participating in the Higgs Yukawa vertex (see below). ^ 



The Cheng and Sher Ansatz ensures the suppression of FCNC withm the first t wo g enerations of quarks, 
as required by the experimental constraints on FCNC in meson transitions, see |28|. 
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Within the most general 2HDM one can always choose a basis where only one of the 
doublets acquires a vacuum expectation value (VEV): ($1) = (O v/^) and ($2) = 0. 
A general 2HDM in this basis is often referred to as the type III 2HDM (or Model III) 

nnn 

|28L I29I. I3CII| ■ With this choice of basis, $1 corresponds to the usual SM doublet and all the 
new flavor changing couplings are attributed to $2- Note also that in this basis tan (3 = Vi/v2 
has no physical meaning.^ 

As in any 2HDM, the physical Higgs sector of Model III consists of 3 neutral Higgs 
bosons (2 CP-even ones, and H^, and one CP-odd state A^) and a charged scalar with 
its conjugate if^. The neutral bosons are given, in terms of the original SU(2) doublets, as: 



—(Re(j)^ — v] sin a + Re 02 cos a 



V2 



Re 05 — ) cos a + Re 02 sin a 



(3.1) 



A° = -V2Im0° . 

The flavor changing part of the Yukawa Lagrangian in Model III is given by j2c 

JC-Y,FC = egO.L02f/,7i + C?Q^L02^,i?^ + H.C. , (3.2) 

where 02 = iT202, Q stands for the quark SU{2)l doublets, U{D) for up-type (down-type) 
quark SU{2)l singlets and S,^ are 3x3 non-diagonal matrices (in family space) that 
parametrize the strength of the FCNC vertices in the neutral Higgs sector. Adopting the 
Cheng and Sher Ansatz we set:^ 



A 



V2G1 



-1/2 



(3.3) 



where for simplicity we assume the Ajj's to be real^ and symmetric (i.e.. A*,- = Xji) con- 
stants. For the Higgs-top-charm coup ling we will take that A^ = Act = A ~ C(l), which is 



compatible with all existing data, see 



11 



28| for details. 



Thus, for the top decays of our interest in this paper, the relevant terms in the Yukawa 



Lagrangian are 



Htc 



-A ^ " fnnct 
V2v 



^ "Switching on" tan/3 by allowing ($2) 7^ will not change any physical result. 

^ Note that there is a factor of 1/2 difference between our definition for Ci^ '^ in fEa. l3.3|l and the one used 
in . This difference may be absorbed by redefining the arbitrary parameters Ay . 

^ In this work we are not interested in CP-violating effects that may be driven by a possible phase contained 
in the Ay 's. 
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HVV 



-gmwGvSng^uV^V 



(3.4) 



where Ti = oi H^, V = W or Z and 



fhO;HO = COS a; sin a, 
Sho-HO = sin a; —cos a. 



G 



W;Z 



1; 



rrir. 



m 



w 



We will further need the Tiqiqi (with Ti = h^, A^) and H^tb couplings 1 iL |28 1 



'HqiQi 



I 1 I • /lO "^ii 



2v 



Xbbrrib - Xttm - Xbbfnb + Xttm 75 



t . 



(3.5) 



(3.6) 



IV. FINITE WIDTH EFFECTS IN THE t cWW AND t cZZ DECAYS 



In this section we will use the CM to evaluate the FWE in the top decays t —>■ cWW 
and t cZZ. Kinematically, the naive threshold (i.e., not including FWE) for the decay 
t —* cZZ is about 4 GeV away (i.e., larger) from the recent CDF la limit (from Tevatron 
RUN II) on the top mass, mt{lcr) < 180.2 GeV ^v\. Also, as will be shown below, even for 
t cWW the available phase space can be (depending on the top mass) small enough for 
the FWE to become significant. 

We will consider the decay t —>■ cWW at the tree-level in both the SM and Model III, 
while t — i> cZZ will be analysed only within Model III, since in the SM this decay is doubly 
suppressed by both one-loop factors and non-diagonal Cabibbo-Kobayashi-Maskawa (CKM) 
elements and is, therefore, unobservably small. 

In the SM, the tree-level decay t — > cWW proceeds via t d*W^ cW^W^ {d = d,s 
or b quarks), with a BR of the order of O{10~^^ — 10"^^) (depending on the top-quark mass) 



if FWE are not taken into account 0. The dominant SM diagram is t — b*W^ cW~W^, 
since Vtb x Vcb is the largest out of the three possible products of CKM elements that enter 
this decay. In Model III there are two additional tree- level diagrams: t ch^* cW^W~ 



and t —>■ cH 



0* 



cW+W- 
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ll|. In this case, we will use the Breit-Wigner prescription 



for the propagators of Ti = or H^, i.e., (g^ — -|- im-yiV-^) ^, where T-j-i is the total Ti 



8 



width calculated from the dominant H decay modes: H —> bb, tt, tc, ZZ, WW, WW*, ZZ*7'^ 
Using the CM, the partial decay width for t —>■ cWW in any given model M can be 
written as [see Eq. (j2.6|) ]: 



^^on.it - cWW) 



mt-mc) 



tJQ 



X 



X 



dPw+ 



dpw- 




1 — ^ 



dX2 \M^I,^^{Xi,X2,Pw+,Pw- 



(4.1) 



where the superscript M stands for the model used for the calculation of the convoluted 
amplitude A^^onv 

•^2, mm 
•max 
E2 



{E2 + E,f~[pl-pl,.+ 



R2 

-^3 



Pw^ 



{E2 + E^f - 
xi-ml+ 



E^ - 

^2 Pw- 



E^ 



El -Pi.. 



Pw+ + 



(4.2) 



2^ 

For the BR calculation, we approximate the total width of the top quark by its dominant 
decay t —>■ bW which is computed at tree-level with the corresponding value of the top quark 
mass. 

In Fig. ^ we plot the BR(t — > cW~^W~) as a function of the top quark mass in the 
SM, with and without FWE. The case of stable W^s in the final state (i.e. without FWE) 
is obtained by taking the limit pipl/, mir, F^) — > 5(p^ — ml^) [see Eq. fl2.5p ] which sets 



Pw± 



m 



w 



in the integrand of Eq. 1)4.11) . The decay t cW~^W~ in the SM with stable 
W^s was calculated in j7i] and our result for this case agrees with hers. From Fig. ^ we see 
that for the CDF central value of the top mass, rrit = 173.5 GeV, FWE can enhance the 
BR(i(: cW~^W^) by about an order of magnitude, reaching ~ 2 ■ 10"^^. For the lower 
la CDF limit rrit ~ 167 GeV, the enhancement due to FWE is of about two orders of 



^ Note that in Model III the decay H ^ tc becomes important for Ate ^ 

® Depending on the Ti. mass, only the kinematically allowed decays will be included in T-j-^. 
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magnitudes. Unfortunately, even with such large FWE in the decay t cW^W , the BR 
in the SM is still too small to be measured - even at the LHC. 



10- 



10- 



10- 



lo- 
rn 



10- 



:" " 1 " " 1 " " 1 ' 


1 1 1 1 1 1 1 1 1 1 1 1 


1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1^ 


r 




'^^"""^^"""^ 


", , , , 1 , , , , 1 , , 




Stable : 




, , 1 , , , , 1 , , , , 


FWE 

, , , , 1 , , , , 1 , , , , 1 , , , , 



150 155 160 165 170 175 180 185 190 195 200 

mt[GoV] 

FIG. 1: The branching ratio for t cWW in the SM, as a function of the top quark mass, without 
FWE (solid curve) and with FWE (dashed curve). The charm quark mass is set to rric = 1.87 GeV 
and Vcb = 0.046. The vertical lines denote the recent (from Tevatron RUN II) lower and upper la 
CDF limits on the top mass. 



In Fig. 121 we show the BR(t cW+W') in Model III with = 1, m^o = 1 TeV 
and a = (note that the SM tree-level contribution to t —>■ cWW, although included, is 
negligible in this function of mt with and without FWE, for several values of the 

light Higgs mass rriho = 130, 150, 170, and 190 GeV, and as a function of m^jo with FWE, 
for the lower, upper and central CDF values of the top-quark mass = 166.9 , 173.5, and 
180.2 GeV. As was found in in Model III without FWE, the BR(t cW+W-) can 

at most reach the level of few x 10~^ if mt lies within its la CDF limits and only if 111^0 ~ mt. 
On the other hand, when FWE are "turned on", a huge enhancement to the width arises 
within a large range of the Higgs mass. In particular, for 100 GeV ^ mho ^ 165 GeV, we 



^ The dependence of BR(f — > cW^W^) and BR(i cZZ) on the Higgs mixing angle a in Model III can be 
found in [lollllj. The maximum of these branching ratios with respect to a takes place at a = 7r/8 (due 
to the dependency of the Higgs width on a) and not at a = 7r/4 which is used through out our analysis. 
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FIG. 2: The branching ratio for t cWW in Model III, for Xtc = 1, mffo = 1 TeV and a = 7r/4. 
On the left: as a function of the top quark mass, without FWE (lower curves) and with FWE 
(upper curves), for mj^o = 130, 150, 170, 190 GeV. On the right: as a function of the light Higgs 
mass m/jO, for mt = 166.9, 173.5, 180.2 GeV. See also caption to Fig.^ 

find BR(t cW+W-) > 10-^ if 167 GeV < < 180 GeV, in Model III when FWE are 
included. Note that, for the lower la limit nit ~ 167 GeV, i.e., close to the threshold for 
producing cWW, the FWE causes an up to six orders of magnitudes enhancement to the 
BR{t cW+W-) if, e.g., rrih ~ 130 GeV. 

For the decay t — > cZZ in Model III we use the analytical results of t — cWW with 
the replacements mw — > ^z/ cos 6*1^ in the TiVV vertex, — * pzi, Vw ~^ Pz2 Eq. ()4.1|1 
and with an additional overall factor of 1/2 to take into account the symmetry factor for 
identical particles in the final state (i.e., Z bosons). Fig. Elshows the scaled branching ratio 
BR(t ^ cZZ)/X^ {X = X tc) in Model III with 771^0 = 1 TeV and a = it/A (see also footnote 
9), as a function of nit with and without FWE, for mf^o = 130, 150, 170, and 190 GeV, 
and as a function of rriho with FWE, for mt = 166.9 , 173.5, and 180.2 GeV. Note that the 
decay t — cZZ is fundamentally different from t cWW, since, unlike t cWW, this 
decay channel cannot occur for stable Z-bosons if mt lies within its la limits. Thus, the 
inclusion of FWE in t ^ cZZ is crucial in this case. In particular, from Fig. El we see that 
a remarkably large BR.(t cZZ) ~ 10^^ — 10~^ is expected in Model III, if m^o lies within 
90 GeV ^ mi^o ^170 GeV. Such a large BR will be accessible to the LHC and may even be 
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detected at the Tevatron. 

Finally we note that, following Q (who took rrib = ms for their calculation oft-^ bWZ), 
we take rric = nir) = 1.87 GeV. 
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FIG. 3: The scaled branching ratio BR(t cZZ^j}? in Model III, for m^jo = 1 TeV and a = ir/A. 
On the left: as a function of the top quark mass, without FWE (lower curves) and with FWE 
(upper curves), for m^o = 130, 150, 170, 190 GeV. On the right: as a function of the light Higgs 
mass m^o, for mt = 166.9, 173.5, 180.2 GeV. See also caption to Fig.\^ 



V. FINITE WIDTH EFFECTS IN THE {tb + tb)W AND /i° ^ {tb + tb)W DE- 

CAYS 

In this section we will examine FWE in three-body decays of neutral Higgs bosons in 
Model III. We will focus on the decay channels —>■ ibW^ and ibW~^ which can have 
both theoretical and experimental advantages for Higgs searches and for investigating Higgs 
properties in the Higgs mass range 200 GeV ^ rriho , m^o ^ 300 GeV. 

The tree level diagrams contributing to these two decays in Model HI are given in Fig. 
El (note that, for the decay, the diagram with an intermediate I^-boson is missing, i.e., 
diagram (d), due to the absence of a tree-level A^WW coupling). A fomula analogous to 
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FIG. 4: Tree-level diagrams contributing to the decay A^{h^) tbW~^ in Model III. 
FIG. 5: Tree-level diagrams contributing to the decay A^{h^) tbW~^ in Model III. 



Eq. ()2.(ij) can be given for Higgs decays as 



T{n baV) 



m-H-mt 



dpi 



m-H-mt-y/pl 



dpi Pi {pI, r°) p2 {pI, my, r^) 
xT^n^bdipDvipl))), (5.1) 



where Ti = oi and a (6) is the top (bottom) quark. Using the interaction terms in 
Section 3, we calculate the matrix element for each decay, where: 

• The propagator of the intermediate W is taken from Eq. ()2.8p . 

• In the calculation of r° in Eq. (jS.lj) . the usual sum over the spins of the outgoing 
top-quark is modified to '^u{pt)u{pt) = j/t+ ^/pt since, using the prescription of the 
CM, the final state top-quark is allowed to be off-shell. 

• Throughout the following we assume that the Higgs mass spectrum respects m/jO < 
m^o -C m^, m^, setting = m^^ = 1 TeV. Thus, the contribution from the charged 
Higgs exchange, i.e., diagram (b) in Fig. El becomes negligible. 

• The total width of A° is estimated from the decays rf, bb, h^Z, h^Z*, {tb+ib)W, 
and the total width of is estimated from the decays rf, bb, W~^W~ , ZZ. 

• We set all the relevant flavor diagonal A's of the Higgs Yukawa couplings in Eq. ()3.6|) 



to unity, i.e., A 
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FIG. 6: The branching ratio BR(A° tbW~ +ibW+) in model III, as a function of the mass, 
with FWE (upper curves) and without FWE (lower curves), for mj^o = 170 GeV (solid curves) and 
m/jO = 230 GeV (dashed- dotted curves). Also, rrit = 173.5 GeV, = 350 GeV and a = 7r/4. 

With the above assumptions, the remaining relevant input parameters (in Model III) for 
evaluating the branching ratios under consideration are m^o, rrtho and the Higgs mixing 
angle a. 

In Fig. El we depict the branching ratio of (th + th)W as a function of m^o, for two 

values of the light Higgs mass myfi = 170 and 230 GeV and for = 1 TeV, rrit = 173.5 GeV 
and a = tt/4. We see that near threshold, i.e., rriAo ~ 260 GeV, there is an enhancement 
of several orders of magnitude due to FWE, wherein the the branching ratio can reach 
BR(A° -> {ib + tb)W) ~ 10"^. Away from threshold, the decay A° (tb + tb)W is sensitive 
to the lightest neutral Higgs mass, m^o. In this case, the inclusion of FWE can increase 
the branching ratio by almost an order of magnitude, giving e.g. BR(A'' — » {ib + tb)W) ~ 
few X 10~^ for m^o ~ 300 GeV and m/iO = 230 GeV. Thus, FWE in the three-body decay 
A^ — > (tb + tb)W can become very significant - bringing its BR to the level of tens of 
percents and making it competitive with the A^ two-body decays and, therefore, a viable 
experimental signature for studies of the properties of the Higgs sector. 

Finally, let us consider the decay (tb + tb)W. In Fig. Owe plot its branching ratio 

as a function of rriho for the same input parameters (of Model HI) as in Fig. IHl In this case. 
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FIG. 7: The branching ratio BR(^° tbW- + ibW+) in model III, as a function of the h^ mass, 
with FWE (upper curve) and without FWE (lower curve), for mt = 173.5 GeV, mH+ = 350 GeV 
and 01 = IT /A. 

in spite of the large enhancement near threshold due to FWE, the BR(/i° {ib + tb)W) 
remains rather small, i.e., at most of (9(10~^), mainly due to the much larger total width 
caused by its tree-level decays to a pair of gauge-bosons — > WW, ZZ. 

VI. SUMMARY 

We have studied and emphasized the importance of FWE (finite width effects) in decays 
occurring just around their kinematical thresholds. For the inclusion of FWE we have 
adapted the so called CM (convolution method). In the CM, the unstable particle with 4- 
momentum p is treated as a real physical particle with an invariant mass and effectively 
weighted by a Breit-Wigner-like density function, which, becomes a Dirac-delta function in 
the limit that the particle's total width approaches zero. 

We first examined the FWE within the SM in the rare and flavor-changing tree-level top 
decay t cW'^W~ and then extended our analysis to FWE in the tree-level top decays 
t — > cW'^W~, t cZZ and Higgs decays ^4°, /i° tbW in a general two Higgs doublets 
model, the so called Model III, which gives rise to tree-level FCNC in the Higgs-fermion 
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sector. In all these case we find that FWE can become substantial - enhancing the branching 
ratios for the above decays by several orders of magnitudes near threshold. 

Unfortunately, in the SM case, the top decay t cW'^W~ remains too small to be of 
any value in the upcoming high energy colliders, i.e., BR^^'(t cW^W~) ~ 10~^^ — 10~^^, 
in spite of the large enhancement due to FWE. On the other hand, in Model 111, the large 
enhancement due to FWE in all these three-body top and Higgs decays can make a difi^erence 
with respect to experimental studies in the upcoming hadron colliders. In particular, the 
branching ratios for the top-decays t — > cW^W~ and t — > cZZ can reach the level of 
10~^ — 10"^ near threshold - many orders of magnitudes larger than the corresponding 
branching ratio for the stable W and Z-bosons case (i.e., without FWE). For the t cZZ 
decay, the inclusion of FWE is essential since such a large branching ratio arises even though 
the naive threshold for this decay is a few GeV away from the most recent Icr upper limit 
on the top mass, ■mt{la) ~ 180 GeV. 

In the Higgs decays, FWE are more noticeable in the pseudo-scalar Higgs decay ^4° — > 
ijb -\- th)W, elevating its branching ratio to the level of tens of percents, thus making this 
three-body decay channel dominant and competitive with its two-body decays and, therefore, 
extremely important for experimental studies. 

Thus, our study shows that FWE is essential for a proper treatment of otherwise neglected 
finite widths of particles which emerge at the final state of decays or scattering processes 
occurring just around the threshold. 
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